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ABSTRACT 

Surveys  of  industrial  scheduling  practices  note  that  operating 
managers  judge  the  effectiveness  of  a  shop  schedule  on  several 
criteria.  Yet,  much  of  the  existing  research  on  scheduling  has 
considered  only  single-objective  problems.  In  this  paper,  we 
address  a  bicriterion  problem  for  a  flexible  manufacturing  system 
which  produces  parts  to  specific  orders.  The  primary  objective  of 
the  scheduling  problem  is  the  minimization  of  total  job 
tardiness,  and  the  secondary  objective  is  to  maximize  the  sum  of 
job  release  times. 

The  significance  of  the  primary  objective  for  any  make-to-order 
system  is  obvious.  The  secondary  objective  is  important  in 
systems  operating  in  a  just-in-time  environment  with  its  emphasis 
on  minimizing  in-process  inventories.  We  present  an  integer 
programming  formulation  of  this  problem,  and  construct  a 
heuristic  hierarchical  solution  method  which  requires  decomposing 
the  original  problem  into  two  subproblems  which  address  the  two 
objectives  independently.  Computational  studies  show  the 
effectiveness  of  the  suggested  solution  procedure  under  various 
test  scenarios. 


1.  INTRODUCTION 

This  paper  addresses  the  Shop  Scheduling  Problem  (SSP)  in  a 
flexible  manufacturing  system  ( FMS )  with  random  material  flows. 
The  SSP  is  a  dual-objective  problem;  the  objective  of  primary 
concern  is  to  minimize  total  job  tardiness,  while  the  secondary 
objective  is  to  maximize  the  sum  of  job  release  times.  The 
requirements  of  these  two  objectives  are  antithetical.  While 
minimizing  total  tardiness  is  a  regular  measure,  maximizing  the 
sum  of  release  times  is  non-regular. 

In  considering  these  two  objectives,  and  by  ordering  them 
lexicographically,  we  associate  two  characteristics  with  the 
make-to-order  system  addressed  in  this  study:  i)  It  operates  in  a 
just-in-time  (JIT)  manufacture  environment  with  emphasis  on  its 
short-  and  long-term  benefits;  and  ii)  in  the  short-term, 
minimizing  the  cost  of  tardiness  is  of  primary  importance.  These 
characteristics  are  now  discussed  in  some  detail. 

The  importance  of  the  primary  objective  for  any  make-to-order 
system  is  obvious.  The  secondary  objective  (and  most  non-regular 
measures  in  general)  is  consistent  with  the  JIT  manufacture 
notion  that  long-term  benefits  due  to  productivity  and  quality 
improvements,  and  short-term  savings,  such  as  reductions  in  work- 
in-process  (WIP)  and  finished  goods  inventory  carrying  charges, 
can  outweigh   the  cost   of  keeping   resources  idle   for  a  certain 


length  of  time.  In  addition,  when  part  processing  times  are  large 
and  the  due  dates  of  some  orders  extend  very  much  into  the 
future,  the  system  needs  to  be  buffered  against  the  quantity  and 
timing  uncertainties  associated  with  such  orders.  In  an  FMS  in 
particular,  because  of  the  significant  costs  of  tool  preparation 
and  part  programming,  it  is  desirable  to  defer  the  commitment  of 
resources  to  these  orders  to  a  later  point  in  time  when  such 
uncertainties  are  reduced. 

The  feasibility  of  deferring  part  production  in  JIT  systems, 
while  simultaneously  ensuring  that  their  due  dates  are  met  on 
most  occasions,  stems,  at  least  partly,  from  the  availability  of 
surplus  production  capacity.  However,  in  spite  of  such  extra 
capacity,  there  may  be  instances  in  which  some  jobs  arriving  at 
the  GFMS  need  to  be  taken  up  urgently.  In  such  cases,  the 
operating  manager  is  faced  with  the  objective  of  minimizing  due 
date  based  penalties  (such  as  tardiness)  associated  with  the 
urgent  jobs,  while  retaining  the  objective  of  deferring  the 
release  times  of  the  other  jobs.  [Because  of  interaction  effects, 
it  may  not  always  be  possible  a  priori  to  identify  the  urgent 
jobs. ] 

In  treating  the  two  objectives  lexicographically,  we  make  a 
distinction  between  the  short-  and  the  long-term  priorities  of 
the  manager.  We  assume  that,  for  the  system  addressed  in  this 
study,    the    short-term    benefits    of    JIT   manufacture   are 


significantly  less  than  the  tardiness-related  costs.  Therefore, 
in  the  event  of  conflict  between  the  two  objectives,  minimizing 
tardiness  is  given  higher  priority.  When  excess  capacity  is 
available,  short-term  conflicts  between  the  two  antithetical 
objectives  are  avoided  on  most  occasions. 

Note  that  deferring  job  release  times  undermines  the  system's 
ability  to  meet  the  due  dates  of  jobs  arriving  in  the  future. 
Even  in  the  presence  of  adequate  production  capacity,  it  can  lead 
to  a  small  deterioration  in  tardiness  values  in  a  dynamic  system. 
Therefore,  if  only  the  short-term  costs  and  benefits  are 
considered,  it  is  never  optimal  to  defer  job  release  times.  [In 
fact,  it  will  probably  be  suboptimal  to  do  so.]  In  the  long  term, 
however,  benefits  due  to  improvements  in  productivity  and  quality 
can  compensate  for  small  increases  in  tardiness.  We  make  another 
observation  here.  Keeping  resources  idle  for  production  purposes 
does  not  imply  that  they  will  remain  unutilized.  In  practice, 
they  will  be  put  to  alternative  uses  such  as  part  program 
testing,  prototype  development,  etc.  While  these  auxiliary 
activites  are  important  for  smooth  ongoing  production  in  an  FMS, 
they  are  usually  scheduled  around  the  schedules  developed  for 
jobs  with  specific  orders. 

This  paper  is  organized  as  follows.  We  review  the  prior  research 
on  related  problems  in  Section  2.  An  integer  programming 
formulation  of   this   problem   is  presented   in   Section  3.   In 


Section  4,  we  discuss  the  heuristic  solution  approach  which  is 
based  on  a  hierarchical  decomposition  of  the  problem  into 
independent  subproblems.  Our  computational  experience  with  this 
approach  is  described  in  Section  5.  We  conclude  in  Section  6 
with  a  discussion  of  the  experimental  results.  The  notation  used 
in  this  chapter  is  given  in  Appendix  1. 

2 .  BACKGROUND 

The  Shop  Scheduling  Problem  has  not  been  addressed  directly  by 
any  researcher  in  the  past.  However,  the  two  objectives  have  been 
studied  individually.  While  the  total  tardiness  problem  has 
atttracted  extensive  attention,  the  research  on  this  problem  has 
primarily  focused  on  the  use  of  priority  dispatching  rules  in 
dynamic  systems.  [See,  for  example,  Carroll  (1965),  Baker  and 
Bertrand  (1982),  Kanet  and  Hayya  (1982),  Baker  and  Kanet  (1983), 
Baker  (1984)  and  Vepsalainen  and  Morton  (1987)].  In  a  recent 
study,  Raman,  Talbot  and  Rachamadugu  (1989)  develop  an  implicit 
enumeration  approach  as  well  as  a  decomposition-based  heuristic 
for  solving  the  static  version  of  this  problem. 

The  secondary  objective  considered  in  this  paper  is  closely 
related  to  the  earliness  problem  studied  by  Sidney  (1977), 
Lakshminarayan  et  al .  (1978),  Chand  and  Schneeberger  (1985, 
1986),  and  Rachamadugu  (1986).  Sidney  (1977)  addresses  a  problem 
in  which   jobs  incur   both  lateness   and  earliness  penalties;  the 


objective  is  to  minimize  the  maximum  of  these  penalties  over  all 
jobs.  Under  certain  restrictive  assumptions,  Sidney  develops  the 
properties  of  the  optimal  ordering  of  jobs  and  presents  an  0(N2) 
algorithm  for  solving  the  problem  optimally.  Lakshminarayan  et 
al.  (1978)  present  an  0(N  log  N)  algorithm  for  solving  the  same 
problem. 

Chand  and  Schneeberger  (1985,  1986)  consider  the  single  machine 
weighted  earliness  problem.  They  show  that  this  problem  is 
antithetical  to  the  problem  of  minimizing  the  total  weighted  job 
completion  times  subject  to  no  late  jobs.  They  propose  a  dynamic 
programming-based  algorithm  for  solving  the  earliness  problem 
exactly.  They  also  construct  a  heuristic  solution  method  which 
requires  a  modification  of  the  procedure  suggested  by  Smith 
(1956).  Rachamadugu  (1986)  derives  valid  lower  bounds  for  the 
weighted  earliness  problem  by  splitting  jobs.  He  formulates  a 
Lagrangean  problem  by  relaxing  the  constraints  on  early  job 
completion.  The  Lagrangean  variables  are  determined  by  a 
multiplier  adjustment  procedure. 

As  we  will  show  later  in  Section  3,  the  secondary  objective  of 
maximizing  the  sum  of  job  release  times  is  equivalent  to 
minimizing  the  sum  of  job  waiting  times.  The  latter  problem  is 
considered  by  Ahmadi  and  Bagchi  (1987)  in  the  context  of  a  two- 
machine  flow  shop.  They  present  several  dominance  properties  and 
a  branch  and  bound  method  for  solving  this  problem  optimally.   In 


this  method,  the  lower  bound  at  any  node  is  derived  by  using  a 
modification  of  Johnson's  procedure  for  minimizing  makespan.  The 
upper  bound  at  any  node  is  determined  by  using  the  Shortest 
Remaining  Processing  Time  heuristic  for  solving  the  antithetical 
completion  time  problem  subject  to  non-zero  ready  times  and  a 
common  due  date.  However,  when  all  jobs  do  not  have  the  same 
due  date,  Ahmadi  and  Bagchi  restrict  their  search  to  permutation 
schedules  only.  They  also  outline  a  heuristic  procedure  for  the 
multiple  (>3)  machine  flow  shop. 

This  study  extends  the  previous  research  to  the  case  of  an  FMS. 
Because  of  the  random  material  flows,  the  FMS  problem  is 
considerably  more  complicated  than  the  single  machine  and  flow 
shop  problems.  To  solve  any  problem  of  reasonable  size, 
therefore,  we  have  to  necessarily  adopt  a  heuristic  solution 
approach.  The  details  of  the  proposed  decomposition-based 
heuristic  method  are  discussed  next. 

3.  PROBLEM  FORMULATION 

An  integer  programming  formulation  of  SSP  is  given  below: 

Maximize    I    ri  (1) 

J 

subject  to 

E  Tj  =  za  .  where  z:  =  min   E  Tj  (2) 

J  J 


I     X 


t  i  k 


=    1 ,    for    each    j ,    k 


(3) 


t+pjk-l 
I      I  I      Rjkl    X,Jk    i    1,    for    each  m,    t 

j       k        q=t 


(4) 


I    (t 
j 


-    Pji)    **  i 


i     * 


r5  ,    if   j    =   1 


E    t   xt  j „  ,    otherwise 

t 


for   each    j,    k,    and    (k,l)    e    Sd 


(5) 


I    t   Xtjk     +   Ej 

t 


-    Tj     =   dj  ,    for    each    j  ,    and   k   =   Nd 


(6) 


xtjk     e     {0,1} ,    for   each   j,    k,    t; 

r\,  ,    Ej  ,    Tj     >    0,    integer    for   each    j 


(7) 


In  this  formulation,  Equation  (1)  refers  to  the  secondary 
objective.  Constraints  (2)  specify  the  primary  objective. 
Constraints  (3)  ensure  that  each  operation  is  completed  exactly 
once.  Constraints  (4)  require  that  each  machine  processes  only 
one  operation  in  any  time  period.  Constraints  (5)  ensure  that 
any  operation  can  be  scheduled  only  after  its  predecessor 
operation  is  completed,  and  the  first  operation  of  any  job  is 
started  only  after  the  job  is  released.  Constraints  (6)  define 
tardiness  while  Equation  (7)  specifies  the  nature  of  the 
variables. 
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SSP  remains  NP-complete .  We  propose  to  simplify  this 
problem  by  decomposing  the  set  of  available  jobs  J.  J  can  be 
treated  as  the  union  of  two  mutually  exclusive  and  collectively 
exhaustive  sets  Jj  ,  which  consists  of  urgent  jobs,  and  J2  which 
comprises  those  jobs  which  can  be  deferred.  If  we  can 
effectively  partition  J  into  Jj  and  J2  ,  then  the  primary 
objective  of  SSP  can  be  seen  to  be  the  minimization  of  total 
tardiness  of  jobs  in  Jj  ,  and  the  secondary  objective  as  the 
maximization  of  the  sum  of  release  times  of  jobs  in  J2  ,  subject 
to  the  requirement  that  these  jobs  be  completed  by  their 
respective  due  dates.  Note  that  this  decomposition  ignores  the 
interaction  between  the  primary  and  the  secondary  objectives  for 
jobs  in  Jj  .  In  effect,  if  Jx  is  not  empty,  we  assume  that  there 
are  no  alternative  optimal  schedules  for  the  minimum  tardiness 
problem  with  different  values  of  the  sum  of  job  release  times. 
The  earlier   formulation  of  SSP  can  then  be  modified  as  below. 

Maximize   z2  =  I    ri  (1) 

3 

subject  to 

I      TV,     =   Zj  ,    where    z}    =   min      Z      Ti  (2)  ' 

I    xt i k    =    1,    for   each   j,    k  (3) 

t 

t  +  Pjx-1 

II  I        Rjkm    xqjk    <    1,    for   each  m,    t  (4) 

j      k        q=t 


I   (t 

t 


-  Pj  i  )  Xtji 


r,  ,  if  1=1 


I    t  xt i  k ,  otherwise 

t 


for  each  j,  k,  and  (k,l)  e  S. 


(5) 


I  t  xt  i  „  +  E.j  -  Tj  =  dj  ,  for  each  j,  and  k  =  Nj 
t 


(6) 


xtjk    e    {0,1},    for   each   j,k,t; 

ri  ,    Ej  ,    Tj     >    0,     integer,     for    each    j 


(7) 


Tj  =0,   for  each  j  e  J2 


(8) 


Equation  (8)  in  the  above  formulation  ensures  that  jobs  in  J  are 
completed  by  their  due  dates.  This  formulation  shows  that  two 
combinatorial  problems  are  embedded  within  SSP.  Equations  (1)', 
(3),  (4),  (5),  (7),  and  (8)  constitute  the  Input  Scheduling 
Problem  (ISP)  of  maximizing  the  sum  of  the  release  times  of  jobs 
in  J2  subject  to  their  timely  completion.  This  problem  has  been 
shown  to  be  NP-complete  even  when  M=l  [ see  Chand  and 
Schneeberger  (1986)].  Equations  (2)',  (3),  (4),  (5),  (6),  and 
(7)  define  the  Multiple-Machine  Tardiness  Problem  (MTP)  of 
minimizing  the  total  tardiness  of  jobs  in  Jj  . 


For  given   job  due  dates,  maximizing   E   r,  is  equivalent 

jeJ2 

to  minimizing  I       (dd  -  r^  )  .  Also, 
jeJ2 
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Nj  +1 
I   (dj  -  r,  )  =  I     I        (c,  t  -  Cj  ,  ±.  ,  ) 

jeJ2  JeJ2   i=l 


where  Cj 4  denotes  to  completion  time  of  operation  i  in  job 
j  ,  c3  §  M  j  «.  ,  =  dj  ,  and  c.,  0  =  r3  .  If  we  denote  the  waiting 
time  of  job  j  after  operation  i  by  W.,  t   ,  then 

cji   -  cj  ,  i  -  i  =  W i  ,  t  -  i  +  Pj  i 

Also,  in  an  optimal  schedule,  a  job  will  be  released 
immediately  before  the  start  of  its  first  operation. 
Therefore, 

Wj  0  =  0 ,  and 

Cj  1   "   Cj  O       Cj  1    ~   rj     —   Pj  1 

Hence,  in  an  optimal  schedule, 


E    (dj  -  r,  )  =   I      I   Wj±  +  I  I      Pji 

jeJ2  jeJ2   i=l       JeJ2  i=l 


Since  the  second  term  on  the  right  hand  side  of  the  above 

equation  is  a  constant,  the  objective  of  minimizing    I    (dj     -    r3  ) 

jeJ2 

is  equivalent   to  minimizing  the  sum  of  job  waiting  times.   [Note 

that  the  definition  of  waiting  time  used  above  includes  earliness 

as  well. ]   For  the  single  machine  case,  this  objective  reduces  to 

minimizing  total  earliness. 
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4.  SOLUTION  APPROACH 

The  modified  formulation  given  in  the  previous  section  motivates 
a  hierarchical  solution  procedure  for  SSP.  At  the  higher  level, 
we  address  the  problem  of  determining  J  into  Ja  and  J2  .  The 
resulting  subproblems,  MTP  for  jobs  in  Jj  and  ISP  for  jobs  in  J2  , 
are  then  solved  at  the  lower  level.  These  three  problems  are  now 
discussed. 

4.1  Determination  of  J,  and  J2 

To  generate  Jz  and  J2  ,  we  solve  an  aggregate  problem  in  which  the 
entire  FMS  is  treated  as  a  single  machine  which  processes  batches 
of  jobs.  A  batch  consists  of  jobs  which  are  to  be  processed 
simultaneously.  The  sequence  of  jobs  within  a  batch  maximizes  the 
sum  of  job  release  times  subject  to  their  timely  completion. 

Based  on  this  sequence,  we  determine  the  processing  time  and  the 
due  date  of  each  batch.  The  objective  of  the  aggregate  problem 
is  to  determine  whether  a  feasible  sequence  of  these  batches 
exists  in  which  all  batches  are  completed  before  their  due  dates. 
If  there  is  no  such  sequence,  batches  are  combined  in  order  to 
increase  the  likelihood  of  feasibility.  The  suggested  procedure 
for  combining  batches  terminates  in  one  of  the  following  two 
ways:  i)  a  feasible  sequence  of  batches  is  obtained,  or 
ii)  there  is  exactly  one  batch  which  is  tardy. 


12 


Jobs  which  belong  to  the  tardy  batch,  if  any,  are  assigned  to  J1  . 
These  jobs  are  resequenced  according  to  the  solution  to  MTP  which 
is  discussed  in  Raman,  Talbot  and  Rachamadugu  (1989).  The 
remaining  jobs  constitute  J2  and  define  the  Input  Scheduling 
Problem  which  is  discussed  in  Section  4.3. 

Partitioning  J  into  Jj  and  J2  ,  therefore,  requires  three  steps: 
i)  formation  of  batches,  ii)  determination  of  batch  processing 
times  and  batch  due  dates,  and  iii)  test  for  feasibility.  These 
steps  are  now  discussed. 

Formation  of  Job  Batches 

At  the  aggregate  level,  it  is  meaningful  to  assume  that  jobs  with 
similar  due  dates  will  be  processed  together.  If  no  interactions 
exist,  a  given  job  j  can  be  released  into  the  system  at  time 
r.j  =  dj  -  Pj  ,  to  maximize  its  release  time  while  ensuring  that  it 
is  completed  by  its  due  date.  However,  when  many  jobs  have 
similar  due  dates,  job  interactions  may  force  one  or  more  jobs  to 
be  released  earlier. 

The  objective  of  the  batching  problem  is  to  group  jobs  of  similar 
due  dates  together.  We  propose  a  cluster-analytic  solution 
approach  in  which  the  similarity  of  two  jobs  is  measured  in  terms 
of  the  squared  difference  of  their  due  dates.  Since  the  number 
of  batches  to  be  formed  is   not   known   a   priori,   it   should  be 
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determined  as  part  of  the  procedure  for  assigning  jobs  to 
batches . 

Several  methods  for  clustering  a  given  set  of  objects  have  been 
suggested  [see,  for  example,  Cormack  (1971)  for  a  classification 
of  these  procedures,  and  Anderberg  (1973),  Hartigan  (1975)  and 
Everitt  (1974)  for  their  description].  Computational  studies  of 
Everitt  (1974)  and  Klastorin  (1985)  indicate  that  most  methods 
perform  reasonably  well  although  they  may  yield  different 
clusters.  Both  Everitt  and  Klastorin  suggest  that  several 
methods  should  be  tried  for  the  same  data  set,  and  the  dominant 
partition  should  be  retained.  However,  it  is  difficult  to  do  so 
in  view  of  the  computational  burden  involved.  Also,  it  should  be 
noted  that  the  solution  to  the  batching  problem  provides  only  the 
initial  composition  of  batches.  Unless  job  due  dates  are  very 
loose  and  machine  utilizations  are  very  low,  it  is  quite  likely 
that  these  batches  will  be  redefined  during  the  test  of 
feasibility  (which  is  discussed  later  in  this  section.  From  this 
perspective,  this  test  itself  can  be  viewed  as  a  clustering 
procedure).  Based  on  this  consideration,  the  approach  of  using 
several  clustering  procedures  in  order  to  obtain  the  best 
partition  of  batches  is  not  particularly  attractive. 

Everitt 's  (1974)  comparative  study  of  several  procedures  showed 
the  superiority  of  the  single- linkage  hierarchical  agglomerative 
approach  for  forming  clusters.  In  this  method,  starting   from  the 
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lowest  level  of  the  hierarchy  at  which  each  batch  consists  of 
only  one  job,  batches  of  increasing  cardinality  are  formed  by 
merging  two  batches  at  a  time.  At  a  given  step,  the  batches 
selected  for  merging  are  those  with  the  minimum  squared 
difference  of  the  mean  due  dates.  The  algorithm  terminates  when 
all  jobs  are  merged  into  a  single  batch.  From  the  batches 
generated  in  this  manner,  the  best  set  of  batches  is  selected  by 
the  set-partitioning  procedure  suggested  by  Klastorin  (1982) 
which  is  based  on  maximizing  the  measure  of  "expected 
distinctiveness".  The  batches  formed  in  the  hierarchical  manner 
are  treated  as  the  vertices  of  a  directed  arborescent  network. 
The  problem  of  determining  the  best  partition  reduces  to  finding 
the  maximum  weight  cut- set  in  this  network  which  can  be  done  in 
0(N)  steps. 

Determination  of  Batch  Parameters 

For  the  given  batches,  we  next  determine  the  processing  times  and 
the  due  dates.  In  order  to  do  so,  we  need  to  determine  the 
sequence  of  jobs  within  each  batch.  Consistent  with  the 
previous  discussion,  this  sequence  should  maximize  the  sum  of  job 
release  times  subject  to  the  requirement  that  they  should  be 
completed  by  their  due  dates.  [A  time-axis  shift  is  required  if 
one  or  more  jobs  are  already  late.]  We  call  this  problem  the  job 
sequencing  problem  (JSP). 
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The  JSP   can  be   viewed  as   the  inversion  of  the  completion  time 

problem  (CTP)   in  which   the  objective   is  to   minimize  the  total 

completion  times   of  jobs  with  ready  times  r' i     =   dm . „  -  di   ,  where 

dm . ,  is  the  maximum   of  the   due  dates   of  jobs   within  the  given 
batch. 

To  see   the  equivalence   between  these   two  problems  consider  the 
example  shown  in  Figure  1.  In  this  3- job  example,  we  have 

d3  <  d2  <  d,  =  dm.„ 

for  the  JSP.  The  corresponding  instance  of  CTP   is  constructed  by 
defining  the  following  job  ready  times: 

r'i    =0,    r'2    =   dx     -    d2  ,    and   r'3    =   d:     -    d3 


SO 


3K 


W//W//A 


2  3  VA   2   V/ZZZft. 


f,r» 


d    d 
JSP 


Y//;/;/;;/// 


c; 


TM 


WAMm  2  k^3~a 


CTP 


/   ^/ 


c  c 


Figure  1  -  Equivalence  of  JSP  and  CTP 


Denoting  the   variables  in   CTP  with  primes,  it  can  be  seen  that, 

in  general, 

c  '  „  . «  =  c„  .  a  ,  and  c '  i    =  d»  .  ,  -  r i   . 
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Therefore,  maximizing  I    r}     in  JSP  is  equivalent  to 

3 

minimizing    I    c'3  in  CTP .  The  desired  solution  to  JSP,  in 
3 

terms  of  job  ready  times,  can  then  be  obtained  by  first  solving 
CTP  to  determine  job  completion  times  c'a  ,  c'2  ,  and  c'3  ,  and  then 
using  the  following  relationship: 

rt    =  d,  -  c'i  =0,  r2  =  dj  -  c'2  ,  and  r,  =  dx  -  c'3  . 

However,  CTP  is  itself  a  hard  problem.  While  this  problem  has 
been  addressed  for  the  single  machine  case  [see,  for  example, 
Hariri  and  Potts  (1983)],  to  our  knowledge  it  has  not  been 
extended  to  multiple  machines.  We  propose  a  heuristic  procedure 
which  is  a  modification  of  Smith's  (1956)  algorithm  for  a  single 
machine  problem,  and  which  generates  a  non-delay  schedule.  The 
procedure  is  given  below.  However,  first  we  give  the  additional 
notation  used  in  the  procedure. 

Oj         The  schedulable  operation  of  job  j 

r(0j  )      Ready  time  of  0., 

p(0j  )      Processing  time  of  0^ 

(-1(0^  )      The  machine  on  which  0^     is  to  be 

processed 
T  The  set  of  schedulable  jobs 
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Algorithm: 

Step  1     Initialize: 

T  =  the  set  of  all  jobs  in  batch  b; 
count  (m)  =  0,  t(m)  =  0,  for  m  =  1,..,  M. 
Go  to  Step  2. 

Step  2     Determine  the  next  operation  assignment  time  t: 

o  =  (0;  j jef},  M(o)  =  (m|n(Oj  )  =  m} ; 


t'(m)  = 


min   (r(0: )|n(03  )  =  m],  if  m  t    M(o) 


0i  so 


0,  otherwise; 


t(m)  =  max[t(m),  t'(m)]; 


m*  =  arg  min  (t(m)j;  t  =  t(m*) 
m 


Go  to  Step  3 


Step  3     Determine  the  next  operation  to  be  assigned 


Find  i  =  arg  min   {p(Oj  ) } 

JEO' 

where  o'  =  { j  J  0t     t    o,  ^(0^  )  =  m* } 


Go  to  Step  4 


Step  4    Update  machine  availability  time  and  o 


count(m*)  =  count(m*)  +  1; 
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sequence  O.,  in  position  count(m*)  on   m* 
t(m*)  =  t(m*)  +  p(0d  ); 
if  0}     is  the  last  operation  of  job  i,  then 

r  =  r\i, 

else,  Oj  =  successor  operation  of  03  ; 
r(0j  )  =  t(m*). 
Go  to  Step  5. 

Step  5     Determine  whether  all  operations  are  assigned: 

If  T  =  0,  stop;   else,  go  to  Step  2. 

This  procedure  generates  a  non-delay  schedule  by  considering  only 
those  jobs  which  are  available  at  a  given  machine  when  the 
scheduling  decision  is  to  be  made  at  that  machine.  Ties  between 
competing  jobs  are  broken  in  favor  of  the  job  with  the  shortest 
imminent  operation  time. 

The  order  of  operations  generated  for  CTP  is  reversed  to  obtain 
the  desired  sequence  of  jobs  within  the  batch  for  JSP.  Based  on 
this  sequence,  the  batch  processing  time  and  the  batch  due  date 
are  determined  as  follows. 

The  processing  time  Pb  of  batch  b  equals  its  makespan.  We  define 
the  due  date  Db  of  batch  b  as 

Db  =  max  [di  ) 
jeb 
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Note  that  the  construction  of  the  sequence  of  jobs  within  a  batch 
ensures  that  the  job  which  is  due  last  is  completed  last,  and 
other  jobs  are  completed  on  or  before  their  due  dates.  Therefore, 
Db  provides  a  valid  representation  of  the  batch  due  date  in  the 
sense  that  all  jobs  are  completed  by  their  due  date  if  and  only 
if  the  batch  that  they  belong  to  is  completed  by  its  batch  due 
date . 

Test  for  Feasibility 

The  procedure  used  for  testing  feasibility  is  outlined  below. 
Step  1     Initialize: 

s  =  l; 

B  =  total  number  of  batches  currently 

available. 
Go  to  Step  2 . 

Step  2     Generate  an  EDD  sequence  of  the  remaining 
batches : 

Starting  from  the  batch  in  position  s, 
generate  an  EDD  sequence  of  all  batches. 

Go  to  Step  4. 

Step  3     Determine  the  next  batch  to  be  investigated: 

s  =  s  +  1; 
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if  s  =  B  +  1,  go  to  step  6; 
else,  go  to  Step  4. 

Step  4    Determine  if  this  batch  is  tardy: 

If  Ctt!  >  D,  ,  ,  ,  go  to  Step  5; 
else,  go  to  Step  3. 

Step  5     Combine  batches,  if  possible: 

If  s  =  1,  go  to  Step  3; 
else,  combine  [s]   with   [s-1]; 
S=S-  1;  B=B-  1; 
redefine  P,  s .  i  ,  and  D(  , .  j  ,  . 
Go  to  Step  2. 

Step  6     Determine  Jx  and  J2  : 

J,    =  { [ 1] J [ 1]  is  late) ,  and 
J2  =  J\J, 

This  procedure  first  arranges  all  batches  in  the  EDD  sequence. 
Because  EDD  minimizes  maximum  lateness,  a  feasible  solution 
exists  if  and  only  if  there  are  no  late  batches  in  this  sequence, 
which  is  scanned  from  front  to  back.  If  no  late  batches  are 
found,  this  procedure  terminates.  Otherwise,  the  first  late 
batch  found  is  merged  with  its  immediate  predecessor,  and  jobs 
belonging  to  these  two  batches  are  resequenced  following  the 
procedure  outlined  in   Section   4.2.     This   step   is   likely  to 


21 


increase  the  likelihood  of  feasibility  as  shown  by  the  following 
result. 

THEOREM  1:  The  total  tardiness  of  any  sequence  is  not  increased 
if  a  late  batch  is  merged  with  the  batch  immediately  preceding 
it. 

PROOF:   Refer  to  Appendix  2. 

Because  at  each  stage  we  combine  the  late  batch,  if  any,  with  its 
immediate  predecessor,  this  procedure  will  terminate  in  at  most 
B  -  1  steps  in  one  of  the  following  two  ways:  i)  A  sequence  is 
found  in  which  all  batches  are  early,  or  ii)  a  sequence  is 
obtained  in  which  the  first  batch  is  tardy  and  other  batches,  if 
any,  are  completed  by  their  due  dates. 

Jobs  which  belong  to  the  tardy  batch  are  assigned  to  Jj  .  These 
jobs  are  resequenced  in  accordance  with  the  solution  to  MTP . 
Note  that  this  resequencing  may  alter  the  makespan  of  the  first 
batch.  In  such  a  case,  the  3-step  procedure  discussed  above  is 
repeated  after  redefining  the  processing  time  of  this  batch.  The 
remaining  jobs  are  assigned  to  J2  .  The  scheduling  of  jobs  in  Jl 
and  J2  is  now  discussed. 
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4.2  The  Multiple-Machine  Tardiness  Problem 

Jobs  in  set  Jj  are  urgent  and  they  constitute  the  subproblem 
pertaining  to  the  primary  objective  of  minimizing  total 
tardiness.  This  problem  is  identical  to  the  static  MTP 
considered  in  Raman,  Talbot  and  Rachamadugu  (1989),  and  the  same 
solution  approaches  can  now  be  applied  to  sequence  jobs  in  Jx   . 

4.3  The  Input  Scheduling  Problem 

The  objective  of  ISP  is  to  maximize  the  sum  of  release  times  of 
jobs  in  J2  subject  to  their  timely  completion.  We  propose 
solving  this  problem  by  using  the  Modified  Smith  Heuristic  (MSH) 
procedure  described  in  Section  4.1. 

In  general,  when  job  due  dates  are  widely  dispersed,  MSH  will 
yield  several  "blocks"  of  jobs.  Each  block  consists  of  jobs  which 
are  processed  together.  Some  or  all  of  these  blocks  may 
correspond  to  the  job  batches  formed  as  part  of  the  aggregate 
problem  considered  in  Section  4.1. 

We  now  discuss  the  experimental  investigation  of  the  proposed 
solution  approach. 
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5.  EXPERIMENTAL  STUDY 

The  experimental  investigation  considered  two  objectives  which 
were  addressed  individually  by  the  two  sets  of  experiments 
conducted.  The  first  set  of  experiments  evaluated  the  merit  of 
addressing  the  dual-objective  problem  over  the  single-objective 
mean  tardiness  problem.  While  it  is  clear  that  a  solution  to  the 
former  should  provide  better  values  of  the  sum  of  job  release 
times,  the  purpose  of  this  set  of  experiments  was  to  examine  the 
margin  of  possible  improvement. 

The  objective  of  the  second  set  of  experiments  was  to  judge  the 
effectiveness  of  MSH  procedure  with  respect  to  known  upper 
bounds.   From  the  due  date  constraints,  we  have 

rj  +  Pj  <  dj  ,  for  j  e  J2 

Hence, 

I       rt       <       I         di     -       I         pj   =  UB 
jeJ2       jeJ2       je^2 

However,  UB  provides  a  weak  upper  bound.  Ahmadi  and  Bagchi 
(1987)  derive  an  upper  bound  for  a  similar  problem  for  a 
two-machine  flow  shop  in  which  all  job  due  dates  are  equal. 
[They  derive  the  upper  bound  also  for  unequal  job  due  dates;  it 
is,  however,  valid  only  for  permutation  schedules  which  are  not 
dominant  for  non-regular  measures.]  To  our  knowledge,  this  is 
the   only   other   upper   bound   available   currently  for  multiple 
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machine  problems  addressing  similar  objectives.  We  will  denote 
this  upper  bound  by  UB0  . 

The  second  set  of  experiments,  consequently,  addressed  a  2- 
machine  flow  shop  with  equal  job  due  dates  and  compared  the 
solution  value  yielded  by  MSH  with  respect  to  UB0  . 

5.1   Experimental  Design 

The  first  set  of  experiments  considered  a  5-machine  system  with 
25  and  50  jobs.  The  number  of  operations  within  each  job  varied 
between  1  and  5.  Each  job  followed  a  random  machine  visitation 
sequence  though  successive  operations  of  a  given  job  were 
processed  in  different  machines.  Operation  processing  times 
varied  uniformly  in  the  interval  (12,87). 

The  due  date  of  dj  of  a  given  job  j  was  determined  by 

d,  =  F  (  I  Pj  ) 
j 

F  was  sampled  from  a  uniform  distribution  in  the  interval 
(F  -  RF/2,  F  +  RF/2).  F  and  R  respectively  control  the  tightness 
and  the  variability  of  job  due  dates.  In  this  study,  six  values 
of  F  -  0.1,  0.2,  0.3,  0.4,  0.5,  and  0.6,  and  two  values  of  R- 
0.5,  and  1.5,  were  used  to  provide  twelve  combinations  of  due 
date  tightness  and  variability. 
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Ten  instances  of  each  problem  scenario  were  randomly  generated. 
Each  instance  was  solved  using  two  approaches.  The  first 
approach  employed  the  sequential  solution  procedure  designed  to 
consider  the  two  objectives  lexicographically  as  given  in  Section 
4.  The  second  approach  considered  only  the  primary  objective  of 
minimizing  total  tardiness.  The  solution  values  with  respect  to 
total  tardiness  and  the  sum  of  job  release  times  obtained  under 
both  approaches  were  recorded  and  averaged  over  the  ten  problem 
instances  for  reporting  purposes.  In  order  to  restrict  the 
computational  costs  within  reasonable  limits,  the  Modified 
Operation  Due  Date  (MOD)  rule  [see,  for  example,  Baker  (1984)] 
was  used  for  solving  the  mean  tardiness  problem  under  both 
approaches.  Hereafter,  we  will  refer  to  these  two  approaches  as 
SSP/MOD  and  MOD  respectively.  In  total,  the  first  set  of 
experiments  considered  240  problems. 

The  second  set  considered  a  2-machine  system  with  25,  50  and  100 
jobs.  Each  job  had  two  operations,  one  at  each  machine,  and  it 
visited  machine  1  first.  Operation  processing  times  were 
selected  from  a  uniform  distribution  in  the  interval  (12,87). 
All  jobs  had  the  same  due  date  d  which  was  determined  by 

d  =  F  (  I   Pj  )  . 

J 

Five  values  of  F  -  0.6,  0.7,  0.8,  0.9,  and  1.0  were  used  to 
generate  increasingly   loose  due   dates.    [As  reported  in  Ahmadi 
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and  Bagchi ' s  (1987)  study  as  well,  we  found  that  F  <  0.6  led  to 
due  date  inf easibility  in  many  cases. ] 

Ten  instances  of  each  problem  were  generated.  For  each  instance, 
the  ratio  of  the  sum  of  job  release  times  obtained  from  SSP  to 
the  upper  bound  derived  by  using  Ahmadi  and  Bagchi ' s  approach  was 
recorded.  The  results  report  the  average  as  well  as  the  minimum 
and  the  maximum  values  of  these  ratios  over  the  ten  problem 
instances.  In  all,  the  second  set  of  experiments  considered  150 
problems . 

5.2   Experimental  Results 

Tables  1  through  3  give  the  results  of  the  experiments  conducted. 
The  performance  of  SSP/MOD  and  MOD  with  respect  to  total 
tardiness  and  the  sum  of  job  release  times  is  shown  in  Table  1. 
For  better  comparison,  the  reported  total  tardiness  values  are 
normalized  with  respect  to  the  sum  of  job  processing  times  for 
better  comparison.  Similarly,  the  sum  of  job  release  times  is 
normalized  with  respect  to  the  sum  of  job  due  dates.  In  Table  1, 
Zj  ,  and  z2  denote  normalized  total  tardiness  and  normalized  sum 
of  release  times  respectively. 

Table  2  reports  the  ratio  of  the  sum  of  job  release  times 
obtained  under  SSP/MOD  to  the  upper   bound  UB   discussed   in  the 
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beginning  of   Section  5  for  the  eight  different  values  of  F  and  R 
under  which  all  jobs  were  completed  on  time. 

Table  3  presents  the  results  of  the  second  set  of  experiments. 
The  values  reported  are  the  ratios  of  the  SSP/MOD  solution  value 
to  the  upper  bound  UB0  given  by  Ahmadi  and  Bagchi ' s   procedure. 


R  =  1.5 
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TABLE  1 

COMPARISON  OF  SSP/MOD  AND  MOD 

Number  of  Jobs  =25 


R  =  0.5 


0.  1 
0.2 
0.3 
0.4 
0.5 
0.6 


(z,  ,  z2  ) 


SSP/MOD 

(0.559,  0.646) 

(0.030,  0.336) 

(0.000,  0.711) 

(0.000,  0.813) 

(0.000,  0.871) 

(0.000,  0.903) 


MOD 

(0.560,  0.646) 

(0.031,  0.308) 

(0.000,  0.205) 

(0.000,  0.154) 

(0.000,  0.123) 

(0.000,  0.102) 


z2 (SSP/MOD) 
z2 (MOD) 


1.00 
1.09 
3.47 
5.28 
7.08 
8.85 


(Zi  ,  z2  ) 


0.1 
0.2 
0.3 
0.4 
0.5 
0.6 


SSP/MOD 

(0.526,  0.660) 

(0.038,  0.434) 

(0.001,  0.762) 

(0.000,  0.879) 

(0.000,  0.906) 

(0.000,  0.924) 


MOD 

(0.532,  0.658) 

(0.042,  0.343) 

(0.002,  0.230) 

(0.000,  0.173) 

(0.000.  0.138) 

(0.000,  0.115) 


z2  (SSP/MOD) 
z2  (MOD) 

1.00 
1.26 
3.31 
5.08 
6.56 
8.03 


R  =  1.5 
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TABLE  1  (CONTINUED) 

COMPARISON  OF  SSP/MOD  AND  MOD 

Number  of  Jobs  =  50 


R  =  0.5 


0.  1 
0.2 
0.3 
0.4 
0.5 
0.6 


(Zj  ,  z2  ) 


SSP/MOD 

(0..430,  0.646) 

(0.004,  0.454) 

(0.000,  0.793) 

(0.000,  0.881) 

(0.000,  0.923) 

(0.000,  0.945) 


MOD 

(0.431,  0.646) 

(0.004,  0.315) 

(0.000,  0.210) 

(0.000,  0.157) 

(0.000,  0.126) 

(0.000,  0.105) 


z2 (SSP/MOD) 
z2 (MOD) 


1.00 
1.44 
3.78 
5.61 
7.32 
9.00 


(Zj  ,  z2  ) 


0.1 
0.2 
0.3 
0.4 
0.5 
0.6 


SSP/MOD 

(0.387,  0.687) 

(0.009,  0.626) 

(0.000,  0.911) 

(0.000,  0.938) 

(0.000,  0.953) 

(0.000,  0.962) 


MOD 

(0.389,  0.683) 

(0.011,  0.347) 

(0.000,  0.230) 

(0.000,  0.173) 

(0.000,  0.138) 

(0.000,  0.115) 


z2 (SSP/MOD) 
z2  (MOD) 


1.01 
1.80 
3.96 
5.42 
6.90 
8.36 
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TABLE  2 
COMPARISON  OF  z,  (SSP/MOD)  WITH  UB 

z2  ( SSP/MOD )/UB 

NJ  =25  NJ  =  50 

R  =  0.5        R  =  1.5        R  =  0.5        R  =  1.5 


0.3 

0.821 

0.880 

0.850 

0.976 

0.4 

0.904 

0.978 

0.927 

0.987 

0.5 

0.947 

0.986 

0.962 

0.993 

0.6 

0.968 

0.991 

0.978 

0.995 

5.3   Analysis  of  Results 

From  Table  1,  SSP/MOD  can  be  seen  to  retain  the  effectiveness  of 
MOD  with  respect  to  tardiness  while  simultaneously  yielding 
better  values  of  the  sum  of  job  release  times.  [The  marginal 
improvement  observed  in  some  tardiness  values  under  SSP/MOD  is 
due  to  the  fact  that  it  uses  a  second  tie-breaking  rule.  When 
two  operations  are  found  to  have  the  same  MOD  value  at  the  time  a 
scheduling  decision  is  to  be  made,  SSP/MOD  favors  the  operation 
of  the  job  in  the  earlier  batch.  Operationally,  this  tie- 
breaking  method  translates  into  the  EDD  rule.  However,  as  seen 
from  the  results,  the  impact  of  the  second  tie-breaking  rule  is 
very  small . ] 
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TABLE  3 
COMPARISON  OF   z7  (SSP/MOD)  WITH  UBn 
2-Machine  System 


Number  F  .  z  ( SSP/MOD )/UB0 

of 
Jobs  Minimum      Maximum      Average 


50 


100 


0.6 

0.908 

0.984 

0.945 

0.7 

0.928 

0.987 

0.957 

0.8 

0.941 

0.990 

0.965 

0.9 

0.950 

0.991 

0.970 

1.0 

0.957 

0.993 

0.974 

0.6 

0.912 

0.978 

0.941 

0.7 

0.930 

0.983 

0.953 

0.8 

0.943 

0.986 

0.962 

0.9 

0.951 

0.988 

0.967 

1.0 

0.958 

0.990 

0.972 

0.6 

0.926 

0.960 

0.942 

0.7 

0.942 

0.968 

0.954 

0.8 

0.952 

0.974 

0.962 

0.9 

0.959 

0.978 

0.968 

1.0 

0.964 

0.981 

0.972 
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When  due  dates  are  quite  tight,  e.g.,  at  F  =  0.1,  there  is 
virtually  no  difference  between  SSP/MOD  and  MOD.  However,  as  due 
dates  become  progressively  looser,  the  relative  performance  of 
SSP/MOD  improves.  Even  at  moderate  due  date  tightness  at  F  =  0.2 
and  F  =0.3,  SSP/MOD  can  be  seen  to  provide  significantly  better 
values  of  z2  .  The  relative  performance  of  SSP/MOD  improves  with 
an  increase  in  the  number  of  jobs  and  due  date  variability. 

The  dependence  of  SSP/MOD 's  (or  MSH's)  performance  on  due  date 
variability  is  brought  out  in  Table  2  as  well,  especially  for  the 
larger  problems.  Even  when  F  =  0.3,  MSH  yields  release  times 
close  to  the  upper  bound  when  R  equals  1.5.  This  is  due  to  the 
fact  that,  with  greater  dispersion  in  job  due  dates,  the  final 
schedule  contains  a  larger  number  of  blocks.  Consequently,  a 
larger  portion  of  jobs  is  completed  close  to  their  due  dates. 

It  is  difficult  to  judge  MSH's  performance  from  Table  2  at  low 
values  of  F  and  R  because  of  the  fact  that  UB  provides  a  weak 
bound.  However,  from  Table  3,  it  can  be  seen  that  MSH  performs 
effectively  for  these  cases  as  well,  at  least  for  the  2-machine 
system  investigated. 

6 .  SUMMARY 

This  study  considers  the  dual  objectives  of  minimizing  total  job 
tardiness  and  maximizing   the   sum   of   job   release   times   in  a 
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lexicographic  manner.  The  proposed  solution  approach  decomposes 
the  set  of  available  jobs  into  two  subsets,  thereby  generating 
two  subproblems  which  address  the  two  objectives  independently. 
The  first  subproblem  considers  the  objective  of  minimizing  total 
tardiness  and  it  can  be  solved  using  the  procedure  suggested  in 
Raman,  Talbot  and  Rachamadugu  (1989).  A  heuristic  solution  method 
is  constructed  to  solve  the  second  subproblem  of  maximizing  the 
sum  of  job  release  times. 

The  experimental  study  indicates  that  significant  benefits  can 
result  from  considering  the  dual-objective  problem  instead  of 
only  the  single-objective  total  tardiness  problem.  This  result 
is  of  interest  to  an  operating  manager  who  is  responsible  for 
controlling  WIP  inventory  levels  in  addition  to  meeting  job  due 
dates  effectively.  Under  the  proposed  decomposition  approach, 
the  quality  of  the  solution  to  the  overall  problem  is  determined 
individually  by  the  solutions  to  the  total  tardiness  problem  and 
the  job  release  time  problem.  In  Raman,  Talbot  and  Rachamadugu 
(1989),  we  proposed  an  efficient  solution  procedure  for  the 
former.  Experimental  results  shown  in  this  chapter  indicate  the 
effectiveness  of  MSH  for  solving  the  latter  problem. 
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APPENDIX  1 

NOTATION  FOR  THE  SHOP  SCHEDULING  PROBLEM 

j  Job  index,  j  =  1,  .  . ,  N 

J  Set  of  available  jobs  =  {j} 

b  Batch  index,  b  =  1, . . ,  B 

m  Machine  index,  m  =  1, . . ,  M 

t  Time  period,  t  =  1, . . ,  T,  where  T  is  the 

scheduling  horizon 

di  Due  date  of  job  j 

Pj  Processing  time  of  job  j 

rd  Release  time  of  job  j 

ci  Completion  time  of  job  j 

Sj  Set  of  pairs  of  adjacent  operations  in 

job  j 

Rj  Number  of  operations  in  job  j 

Tj  Tardiness  of  job  j  =  max  (0,  c^  -  d.,  ) 

Ei  Earliness  of  job  j  =  max  (0,  d^  -  ci   ) 

Pj K  Processing  time  of  operation  k  in  job  j 

Db  Due  date  of  batch  b 

Pb  Processing  time  of  batch  b 

Cb  Completion  time  of  batch  b 

[s]  The  batch  in  position  s  of  a  given  sequence 
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*t 


i   h 


1,  if   operation  k  of  job  j  is  completed  at 
time  t 


0,  otherwise 


Rj  k  m 


1,  if  operation  k  of  job  j  requires 
machine  m 

0,  otherwise 
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APPENDIX  2 
PROOF  OF  THEOREM  1 

Let  o  be  the  sequence  obtained  by  ordering  batches  according  to 
EDD  as  shown  in  Figure  2.   Let  y  be  the  first  late  batch  in  0  and 
let  batch  x  be  its  immediate  predecessor.    Let  a'  be  the 
sequence  obtained  when  x  and  y  are  combined  to  yield  batch  z  as 
ohown  in  Figure  3 . 


x 


t+P, 


t  +  Px+Py 


Figure  2  -  Sequence  o 


t  +  P, 


Figure  3  -  Sequence  0 


Remark  1:   D,  =  Dy 


Proof:   From  the  definition  of  batch  due  dates,  we  have 


D,  =  (d,.  I  x*  =  arg  max  (d3  ) } 

j  ex 

Similarly,   Dy  =  {dy.  j  y*  =  arg  max  (d.,  ) 

jey 
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and  D,  =  {dx.  j  z*  =  arg  max  (dj  )} 

j  ez 

Since  Dx  ^  Dy  ,  we  have  dx .  <  dy .  .  Therefore, 

D,  =  d,.  =  dy.  =  Dy 

Remark  2 :   P,  <  Px  +  Py 

Proof:  The  procedure  of  sequencing  jobs  within  a  batch  ensures 
that  all  jobs  of  batch  x  will  precede  all  jobs  of  batch  y  in  the 
combined  batch  z.  Also,  since  no  idle  time  is  permitted  this 
sequence,  those  jobs  which  were  in  y  will  complete  at  the  same 
time  or  earlier  in  z.  The  result  stated  in  Remark  2  follows  from 
this  observation. 

To  prove  the  theorem,  it  suffices  to  show  that, 

t  +  Px  -  D,  <  t  +  Px  +  Py  -  Dy 

or        Dx  -  P,  £  Dy  -  (P.  +  Py  ) 

This  results  follows  directly  from  Remarks  1  and  2.  This 
completes  the  proof. 
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